Figure 5. Evaluators conducted a sensitivity analysis for
the effectiveness factor which pointed to alternatives
1A, 2A, and 3A as most effective
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System Architecture value tree. It presents data for
both the baseline, or current, system and the eight
other alternatives outlined in Figure 1. For the
same nine options, Figure 4 plots first- or top-level
effectiveness versus implementation scores. A low
implementation score indicates a costly, difficult-
to-transition system, whereas a high score denotes
an inexpensive, easy-to-transition system; only
alternatives falling near the outer envelope are
optimal candidates.

Because the top-level weights were difficult to
establish, evaluators conducted a sensitivity analy-
sis for the effectiveness factor. The results, dis-
played in Figure 5, pointed to alternatives I A, 2A,
and 3A as most effective, depending upon the rela-
tive weights assigned to effectiveness and imple-
mentation. Alternative 1A totally dominated the
baseline system, thus indicating that the implemen-
tation of that option would be better than the
status quo under any circumstances.

Given this justification for a change, decision-
makers focused their attention on identifying the
alternative that best satisfied effectiveness and
implementation criteria. Two candidates, 2A and
2C, delivered solid performance at reasonable
implementation costs throughout the range.
Because family 1 alternatives were only marginally
more effective than the status quo, officials elimi-
nated them from consideration. They also excluded
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Figure 6. Using option 2A as the new baseline, evaluators
defined end ranked seven,more finely tuned alternatives
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family 3 due to the high cost and risk it would
entail if implemented in 1995.

Based on results of the initial evaluation, ana-
lysts decided to identify additional options within
family 2 and then conduct a second evaluation.
Using option 2A as the baseline alternative for the
family, the design team defined three incremental
improvements in the areas of interoperability,
communications security, and satellites. Labeled
options I, C, and S, respectively, these three im-
provements, combined with one another, yielded
four additional alternatives (1C, CS, IS, and ICS),
bringing the total number to eight. (The current, or
status quo, system was no longer an alternative at
this point.)

Evaluated against the same effectiveness and
implementation criteria discussed above, the
eight alternatives ranked as shown in Figure 6. Op-
tion 2A was now the least costly, but also the least
effective, alternative. Results indicated that, given
additional resources, DoD should first acquire the
satellite improvement, then the interoperability
improvement, and finally the communications
security improvement. Program officials therefore
instructed the design team to use features of the
2A, S, IS, and ICS options in developing even
more detailed architectures for a third and final
evaluation.
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